Skip to content

Add evaluation support for DS V4#2463

Open
yiliu30 wants to merge 37 commits intomasterfrom
dsv4
Open

Add evaluation support for DS V4#2463
yiliu30 wants to merge 37 commits intomasterfrom
dsv4

Conversation

@yiliu30
Copy link
Copy Markdown
Contributor

@yiliu30 yiliu30 commented May 7, 2026

MODEL=/media/yiliu7/deepseek-ai/DeepSeek-V4-Flash
CUDA_VISIBLE_DEVICES=4,5,6,7 bash run_evaluation.sh -s w4a8 -t gsm8k -tp 4 -b 16 -m $MODEL -kv fp8
CUDA_VISIBLE_DEVICES=4,5,6,7 bash run_evaluation.sh -s mxfp4 -t gsm8k -tp 4 -b 16 -m $MODEL -kv fp8

Depends on yiliu30/vllm-qdq-plugin#2

chensuyue and others added 30 commits April 3, 2026 15:45
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
* add vllm qdq

Signed-off-by: yiliu30 <yi4.liu@intel.com>

* add ct setup

Signed-off-by: yiliu30 <yi4.liu@intel.com>

* fix

Signed-off-by: yiliu30 <yi4.liu@intel.com>

* Update run_quant.sh

---------

Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
* add nvfp4

Signed-off-by: yiliu30 <yi4.liu@intel.com>

* fix

Signed-off-by: yiliu30 <yi4.liu@intel.com>

---------

Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
yiliu30 and others added 7 commits April 27, 2026 06:40
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: yiliu30 <yi4.liu@intel.com>
@yiliu30 yiliu30 changed the title dsv4 Add evaluation support for DS V4 May 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants